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Abstract 


A  framework  for  studying  asymptotic  orders  of  reachability  in 
perturbed  linear,  time-invariant  systems  is  developed.  The  systems  of 
interest  are  defined  by  matrices  that  have  Taylor  or  Laurent 
expansions  in  the  perturbation  parameter  e  about  the  point  0.  The 
reachability  structure  is  exposed  via  the  Smith  form  of  the 
reachability  matrix.  This  approach  is  used  to  provide  insight  into 
the  kinds  of  inputs  needed  to  reach  weakly  reachable  target  states, 
into  the  structure  of  high-gain  feedback  for  pole  placement,  and  into 
the  types  of  inputs  that  steer  trajectories  arbitrarily  close  to 
almost  ( A , B) -invar iant  subspaces  and  almost  ( A , B)-contro 1 labi 1 i ty 
subspaces . 
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I.  INTRODUCTION 


1,1  MOTIVATION 


In  this  paper,  we  develop  and  apply  a  theory  of  asymptotic 
orders  of  reachability  in  linear  time-invariant  systems 
parametrized  by  some  small  variable,  e.  To  provide  a  motivation 
for  the  key  issues  in  our  approach,  consider  the  following 
discrete  time  system  as  an  example: 


Examp 1 e  1 . 1 

x[k+l]  = 


1  1 

.01  2 


x[k]  +  [  Qj  u[k] 

This  system  is  reachable  but  the  reachability  matrix 
[b|Ab]  = 


1  1.01 

01  .03 


is  not  very  far  from  a  singular  matrix,  in  that  its  condition 

4 

number  is  approximately  10  .  This  leads  to  numerical  difficulties 
in  determining  reachability,  as  shown  in  [3].  Also,  consider  the 
minimum  energy  control  problem  for  this  system.  The  minimum 
energy  control  to  reach  x[2]  =  [1  0]’  (where  ’  denotes  the 
transpose)  from  x[0]  =  0  is  Uj[l]  =  -.5  and  Uj^[2]  =  1.5,  while  the 
minimum  energy  control  for  x[2]  =  [1  1]’  is  UgCl]  =  49.7  and 

~  -49.  This  order  of  magnitude  difference  between  u^  and  u^ 
is  another  indication  of  near  unreachability.  Still  further 
indications  may  be  obtained,  for  example  by  considering  how  small 
a  perturbation  of  the  system  matrices  suffices  to  destroy 
reachability  (in  this  case,  0.01),  or  by  examining  the  magnitude 
of  feedback  gain  required  to  shift  poles  by  various  amounts  (in 


1 


this  case,  to  move  the  eigenvalues  by  2,  feedback  gains  of 

2 

magnitude  approximately  10  are  required,  as  illustrated  in 
Examp 1 e  3 . 1 )  .  • • 

Our  treatment  of  problems  of  this  type  is  qualitative  rather 
than  numerical  in  nature:  we  assume  that  small  values  in  the 
system  are  modeled  by  functions  of  a  small  parameter  e,  which 
implicitly  indicates  the  presence  of  different  orders  of  coupling 
among  state  variables  and  inputs.  Parametrized  linear  systems  are 
studied  in  general  by  Kamen  and  Khargonekar  [13]  and  Brewer  et  al . 
[14].  However,  we  look  at  how  unreachable  the  system  is  in  terms 
of  "orders  of  e".  Specifically,  we  consider  continuous  time  and 
discrete  time  systems  of  the  form 


x(t)  =  A(e)x{t)  +  B{e)u(t)  (1.1) 

x[k+l]  =  A(e)x[k]  +  B{e)u[k]  (1-2) 

where  A(e)  and  B{e)  have  Laurent  expansions  around  e=0: 

A(e)  :  IR"((e))  (1.3) 

B(e)  :  «">((£))  K^((fc))  (1.4) 


(We  write  a(e)  €  JR((e))  if  a(e)  has  a  Laurent  expansion  around 
e=0.)  Defining  these  systems  over  IR((e))  permits  us  to  examine 
the  effect  or  necessity  of  high  gain  feedback. 

This  work  was  particularly  motivated  by  the  numerical 
problems  encountered  in  various  pole  placement  methods  and  in 
evaluating  system  reachability.  Pole  placement  and  related 
numerical  issues  are  addressed  using  various  approaches  in  the 
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current  literature  [4-7].  In  multi-input  systems,  unlike 
single-input  systems,  the  feedback  matrix  that  produces  a  given 
set  of  poles  is  not  unique,  and  the  additional  degrees  of  freedom 
may  be  used  to  attain  other  control  objectives  (see  [7]).  One 
may,  for  example,  attempt  to  minimize  the  maximum  feedback  gain; 

[5]  addresses  this  problem  via  numerical  examples  on 
redistribution  of  the  feedback  task  among  the  Inputs  and  balancing 
the  A  and  B  matrices.  These  examples  contain  some  intuitive 
ideas,  but  have  not  led  to  systematic  procedures  that  work  well 
for  well-defined  and  substantial  classes  of  systems.  One  of  our 
objectives  here  is  to  suggest  an  analytical  approach  to 
understanding  and  structuring  feedback  gains  for  pole  placement. 

Another  area  of  numerical  work  involves  criteria  to  measure 
controllability.  Boley  and  Lu  [9]  use  the  "distance  to  the 
nearest  uncontrollable  system"  as  a  criterion.  They  define  this 
by  the  minimum  norm  perturbation  that  would  make  a  system 
uncontrollable.  They  also  relate  this  concept  to  state  feedback 
by  measuring  the  amount  that  the  eigenvalues  move  due  to  state 
feedback  of  bounded  magnitude.  Connections  may  also  be  made  to 
the  literature  on  balanced  realizations,  [8],  where  the  singular 
values  of  the  controllability  Crammian  are  used  to  indicate 
nearness  to  uncontrollability. 

The  issue  of  controllability  in  perturbed  systems  of  the  form 
(1.1)  has  been  examined  by  Chow  [15].  He  defines  a  system  to  be 
strongly  controllable  if  the  system  is  controllable  at  e  =  0. 
Otherwise,  he  calls  it  weakly  controllable  and  concludes  that  pole 
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placement  of  such  systems  will  require  controls  with  large  gains. 
Chow  looks  at  systems  with  two  time  scales  (slow  and  fast),  and  he 
proves  that  a  necessary  and  sufficient  condition  for  such  a 
’singularly  perturbed’  system  to  be  strongly  controllable  is  the 
controllability  of  its  slow  and  fast  subsystems. 

Our  analysis  goes  further  than  Chow’s  in  that  we  examine  the 
relative  orders  of  reachability  of  different  parts  of  the  state 
space.  The  methods  we  use  have  some  similarity  to  those  used  by 
Lou  et  al .  [1,2],  who  relate  the  multiple  time  scale  structure  of 

the  system  (1.1)  to  the  invariant  factors  of  A(e),  when  this 
matrix  has  entries  from  the  ring  of  functions  analytic  at  e  =  0. 
The  Smith  decomposition  of  A(e)  plays  a  key  role  in  their 
analysis,  while  the  Smith  decomposition  of  the  reachability  matrix 
is  central  to  the  development  in  this  paper.  While  the  primary 
focus  of  the  work  in  [1,2]  is  on  time  scale  structure,  some 
attention  is  paid  to  control.  In  particular,  [1]  gives  results  on 
the  use  of  feedback  in  (1.1)  to  change  the  time  scale  structure  of 
the  system.  The  work  in  [22]  may  be  seen  as  a  continuation  of  the 
work  in  [1,2]  in  that  it  analyzes  the  effect  of  control  and 
feedback  on  the  system  of  (1.1).  This  paper  is  based  on  the  work 
in  [22]. 

1.2  OUTLINE 

In  Section  II,  we  develop  a  theory  of  orders  of  reachability. 
We  start  with  discrete  time  systems  and  illustrate  that  the  orders 
of  reachability  can  be  recovered  from  the  Smith  decomposition  of 
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the  reachability  matrix.  We  define  a  standard  form  which  displays 
these  orders  explicitly.  Also,  we  show  that  equivalent  results 
hold  for  continuous  time  systems.  In  Section  III,  this  theory  is 
extended  to  pole  placement  by  full  state  feedback  for  systems 
whose  entries  have  Taylor  expansions  around  e=0.  We  also  provide 
a  computationally  efficient  and  numerically  well-behaved  algorithm 
for  pole  placement.  Section  IV  develops  connections  with  Willems’ 
work  on  "almost  invariance"  [3].  We  show  that  the  subspace  a 
sequence  of  { A , B)-control labi 1 i ty  subspaces  converge  to  is  almost 
{A,B)-invariant .  In  Section  V,  we  summarize  our  results  and 
suggest  problems  for  further  research. 

1.3  ASSUMPTIONS 

The  reachability  matrix  for  the  systems  in  (1.1)  and  (1.2)  is 
‘g(e)  =  [B(e)|A(e)B(e)|  ...  |  A*"’^  (e)B(e)  ]  :  lR"‘”((e))  IR”((e)). 

We  assume  that  the  coefficients  of  the  characteristic  polynomial 
of  A(e)  are  over  lR[[e]],  i.e.  they  have  Taylor  expansions  around 
e=0.  We  shall  show  (Proposition  2.6)  that  this  is  equivalent  to 
the  system  being  what  we  term  a  proper  system.  This  is  not  a 
restrictive  condition  for  continuous  time  systems  since  it  can  be 
achieved  by  time  scaling.  However,  it  ^  a  restrictive  assumption 
for  discrete  time  systems. 

Note  that  ^(e)  can  be  made  analytic  at  e  =  0  (i.e.  made  into 
a  matrix  over  KC[e]])  by  a  simple  input  scaling,  and  this  will  be 
done  when  convenient.  In  addition,  we  assume  that  the 
reachability  matrix  is  full  row  rank  for  all  e  €  (0,a),  a€IR^ .  In 
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the  cases  of  most  interest  to  us,  the  reachability  matrix  will 
lose  rank  for  e  =  0.  and  a  will  be  the  smallest  positive  value  of 
B  for  which  the  reachability  matrix  loses  rank.  Under  these 
conditions,  we  analyze  the  asymptotic  reachability  of  the  system 
as  e-lO. 
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II.  ORDERS  OF  REACHABILITY 


II.  1  e-^ -REACHABILITY 

We  start  by  developing  our  theory  of  asymptotic  orders  of 
reachability  in  an  analogous  way  to  existing  linear  control 
theory.  In  order  to  provide  a  motivation  for  our  approach,  let  us 
start  with  the  following  counterpart  of  Example  1.1: 


This  system  is  reachable  for  all  e  C  (0,2).  The  minimum  energy 
control  sequence  needed  to  go  from  the  origin  to  Xj[2]  =  [1  0]’ 
is  Uj[l]  =  -l/(2-e)  and  Uj[2]  =  3/{2-e),  which  is  0(1).^^^  The 
minimum  energy  control  sequence  for  X2[2]  =  [1  1]’  is  u^Cl]  = 
(-e+1 )/e{2-e)  and  u^CS]  =  (2e-l )/e(2-e) ,  which  is  0{l/e). 

We  next  generalize  this  characterization  of  target  states  by 
the  order  of  control  sufficient  to  reach  them. 

Def  ini  tion  2.2:  x(e)  €  is  e '^-reachable  if  there  exists  an 

0(l/fc^)  input  sequence  '^{e)  =  [u’[n-l]  •••  u’[0]]’  such  that  x(e) 


"^f(e)  is  O(e^)  if  lim  llf(e)ll/e^  exists,  where  k  is  an  integer,  f(e)  is 

eiO 

a  scalar,  vector  or  matrix,  and  li»<ll  denotes  the  appropriate  norm. 

k  k-1  k-2 

Note  that  if  f{e)  is  0(e)  then  it  is  also  0(e  ),  0(e  )  etc. 
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is  reached  from  zero  in  n  steps  using  ^(e)  (i.e.  x{e)  =  ‘e{e)‘?Z(fc) )  . 
Let  be  the  set  of  all  e*^-reachable  states,  then  3C^  C  C  9C^  C 
...  and  St^  is  an  IR[ [e] ]-submodule  of  IR^[[e]].  We  term  the 
& '^-reachable  submodule.  •  • 

Note  that  if  x(fc)  is  e'^-reachable ,  then  {l/e)x(e)  is  not 
necessarily  e'^-reachable .  Thus  if  we  had  considered  target  states 
in  IR^{(e))  in  Definition  2.2,  then  the  set  of  reachable  states 
would  not  be  IR(  (e)  )-subspaces  . 

In  Example  2.1,  =  Im[l  0]’  +  eIR^[[e]]  ,  d}  =  =  ...  = 

IR^CCe]]. 

An  interesting  property  of  the  set  of  e'^-reachable  submodules 
is  that  all  the  structure  is  embedded  in  the  e^-reachable 
submodule.  First  of  all,  note  that  sP  is  the  image  of  the 
reachability  matrix  under  the  set  of  all  control  sequence  vectors 
‘V.(e)  in  K^^CCb]]-  Also,  the  e*^-reachable  submodule  is  simply 
obtained  by  scaling  the  ^-reachable  submodule  by  1/e.  To  state 
this  formally: 

Proposi  tion  2.3:  z=  {'6(e)R"’^[  [e]  ]  }niR^[  [e]  ]  and 

^  ^  n  £^1R^[[£]]}.  for  nonnegative 

e 

integers  i,  j  and  j>i. 

Proof:  By  Definition  2.2,  [e]  ]  }niR”[  [e]  ]  ,  or  in 

general  SC^  =  {<6(6)  l/e'’lR"‘"[[e3]}niR’^[[e]]  .  Then, 

iy{a:J""ne"iR^[[e]]}  =  iY{{-4rT‘e{^)R“''CC^]]>ne^iR’^C[e]]} 

e  e  e*^ 
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=  {-4‘e{£)iR"’"CC£]]}nK”C[e]]  = 


The  structure  of  the  e'^-reachable  submodules  is  not  always  as 
easily  obtained  by  inspection  of  the  pair  {A(e),B(e))  as  it  was  in 
Example  2.  To  illustrate  this,  consider  an  e  perturbation  of 
Example  2.1: 

Example  2.4: 

x[k+l]  =  2 

where 

no  = 

This  system  is  reachable  for  all  e  €  (O,®®).  In  this  case,  we  find 

that  Xj[2]  =  [1  0]’  is  e-reachable,  and  X2[2]  =  [1  1]’  is 
2 

e  -reachable.  Therefore,  even  an  e  perturbation  may  cause  drastic 
changes  in  our  submodules. 


1 1. 2  SMITH  DECOMPOSITION  OF  -gCe) 


The  key  element  in  our  results  is  the  Smith  decomposition  of 
'€(e)  since  we  are  Interested  in  how  ^{e.)  becomes  singular  as  eio. 
For  simplicity,  as  noted  in  the  Introduction,  let  us  assume  that 
‘6(e)  has  a  Taylor  expansion  around  e=0  and  that  it  is  full  row 
rank  for  all  e  €  (0,a),  a€IR^ ,  then  the  nxmn  matrix  ‘6(e)  has  a 
Smith  decomposition  [1,  2,  11,  12] 

‘6(e)  =  P(e)D(e)Q(e)  (2.1) 

where  P(e) ,  nxn,  is  unimodular  (detP(O)^O) ,  Q(e),  nxmn,  is  full 
row  rank  at  e=0,  and 

D(e)  =  diag{I  .  el  .  ...  .  e^I  }  (2.2) 

Pq  Pi  Pk 
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is  nxn  where  I  denotes  a  p . xp .  identity  matrix  with  p . =0 

D  11  1 

corresponding  to  absence  of  the  i-th  block,  and  with  Pj^?J0.  The 
indices  p^,  and  hence  D{e),  are  unique,  though  P{e)  and  Q(e)  are 
not . 

Now.  =  P(e)‘3/^  where 

+  ...  +  +  e^“'’^[[e]]  (2.3) 

and  S.  =  Im[I  0]',  n.  =  p«+  ...  +p.  .  In  fact  *3/^  is  the 
1  '-n.-'  i  ^0  *^i 

1 

e'^-reachable  submodule  of  the  original  system  similarity 
transformed  by  P{e)  and  its  structure  immediately  follows  from  the 
indices.  This  property  is  captured  in  a  standard  form  defined  in 
the  next  section. 

I I. 3  STANDARD  FORM 

Consider  a  pair  (A(e),B{e))  with  a  Smith  decomposition  of  its 

reachability  matrix  defined  as  above.  We  will  term  such  a  system 
k 

an  a  -reachable  system  with  indices  nQ,  .  .  . 

A{e)  =  P"^(e)A(e)P(e)  and  B{e)  =  P"^{e)B(e).  The  pair  (A(fc).B(e)) 
will  be  called  a  standard  form  for  {A{e),B{e)). 

The  system  in  Example  2.1  is  already  in  standard  form.  For 
the  system  in  Example  2.4,  a  Smith  decomposition  of  the 
reachability  matrix  is: 

=  [i  ?][J  -r]  =  ne)D(e)Q(e) 

Transforming  the  system  by  P(e)  yields 

yCl^+l]  =  [1*5  *  [o] 

2 

which  uncovers  the  previously  hidden  a  structure. 
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A  standard  form  of  a  system  is  termed  a  proper  s tandard  form 


if  it  has  the  following  structure 


A(e)  = 


eAi  o(e) 


1/eAo  i{e) 


k(t) 

l/a^  A^  j^(e) 


}P 

}Pi 


0 


}Pi 


(2.4a) 


B(e)  = 


Bo{e) 

eB^(e) 


}P 

}P. 


0 


>Pi 


{2.4b) 


where  A.  .(e)  are  analytic  at  e=0,  and  n.  =  )  p.. 

1  *  J  ^  ^  3 

j=0 

Example  2.1  and  the  transformed  version  of  Example  2.4  are 
both  in  proper  standard  form.  In  fact,  the  next  result  shows  that 
finding  one  proper  standard  form  is  enough  to  conclude  that  all 
standard  forms  of  a  pair  are  proper: 


Proposi tion  2.5:  If  a  pair  (A(e),B(e))  has  a  proper  standard  form, 
then  all  standard  forms  of  (A{e),B(e))  are  proper. 

Proof :  Let  ‘€(e)  =  P^  {fc)D(e)Qj^  (e)  =  P2(e)D(e)Q2(e)  ,  then 

Aj(e)  =  P^ ^ {e)A(e)Pj (e) ,  Bj(e)  =  Pj^(e)B{e)  for  i=1.2  are  two 

standard  forms.  Suppose  that  the  pair  ( A  (e)  ,  B^  (e )  )  is  a  proper 

standard  form.  Let  Aj{e)  =  D  ^ (e)Aj {e)D{e) ,  Bj(e)  =  D  ^(e)B^(e) 

for  i  =  l,2.  Note  Aj{e)  and  Bj^(e)  are  both  over  K[C&]]-  We  wish  to 

show  that  the  same  is  true  for  A2(&)  and  B2(a).  Let 

R{e)  =  D  ^ (e)P2^ (fc)P2 (fc)D(e) ,  then  R{e)  is  invertible,  and 

Q2(e)  =  R{£)Qj^{e).  But  then  R(e)  =  Q2{&)Qj(£)  and 

R  ^(e)  =  Qj(fc)Q2{^)*  where  Qj(e)  denotes  the  right  inverse  of 
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Since 


Q^{e),  which  exists  over  iR[[e]].  Thus,  R(e)  is  unimodular. 

(Aj  (e)  ,Bj  (e) )  is  over  IR[[e]]  and  A2(e)  =  R{e)Aj{e)R  ^(e), 

BgCe)  =  R(e)Bj(e),  the  pair  (AgCe) . BgCe) )  is  also  over  E[[e]]. 
Therefore,  (A2(£) tB2(£) )  is  a  proper  standard  form.  •* 

A  pair  (A(e),B(e))  is  termed  proper  if  it  has  a  proper 
standard  form.  Thus,  both  of  the  systems  in  Examples  2.1  and  2.4 
are  proper.  Our  assumption  that  the  coefficients  of  the 
characteristic  polynomial  of  A(e)  are  over  IRC[e]]  is  necessary  and 
sufficient  for  a  system  to  be  proper.  In  general,  we  have  the 
f  ol lowing : 

Proposi tion  2.6:  The  following  statements  are  equivalent  for  any 
pair  (A(e),B(e))  such  that  'g^{e)  is  over  IRCC&]]: 

1.  (A(e),B(e))  is  proper. 

2.  is  over  IR[[fc]]. 

3.  The  coefficients  of  the  characteristic  polynomial,  a(A(e)),  of 
A(e)  are  over  IR[[e]]. 

To  prove  this  result,  let  us  first  consider  the  following  two 
lemmas : 

Lemma  2.7:  For  a  pair  (A(e),B(e))  with  'e_(e)  over  IR[[e3],  is 

W 

over  lR[[e]]  iff  the  coefficients  of  a(A(e))  are  in  IR[[e]]. 

Proof  :  (->)  Follows  using  the  Cay  1  ey-Hami  1  ton  theorem. 

(«-)  Suppose  not  all  coefficients  of  a{A(e))  are  in  IR[C&]].  then 
some  eigenvalue  of  A(e),  say  X{e),  is  not  0(1).  Let  the  Jordan 
decomposition  of  A{e)  in  some  interval  e€(0,a)  be 
A(e)=X  ^A{e)X(e),  where  X(e),  A{e)  are  continuous  and  X{e)  is 
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scaled  such  that  lim  X(e)  exists.  See  [23]  for  the  existence  of 

fciO 

such  a  decomposition.  Consider-' 

X(e)AJ(e)'€(e)  =  A'’ (e)X(e)<e(e)  (2.5) 

i  "til 

Note  that  some  row  of  A'^(e),  say  the  i^  row,  has  the  form 
[0  ...  0  X'^{e)  0  ...  0],  while  the  i^^  row  of  X{e)‘e(e)  is  nonzero 
and  hence  of  finite  order  in  e.  Thus,  by  choosing  j  large  enough, 
we  can  obtain  a  right  hand  side  in  (2.5)  that  is  not  0(1).  It 
follows  that  A*^(e)‘S(e)  is  not  0(1)  for  large  enough  j.  But  ‘6^(e) 
contains  the  entries  of  A^(e)‘6(e),  so  is  not  0(1).  •• 

Lemma  2.8:  Let  A(e)  =  D  ^(e)P  ^ (e)A(e)P(e)D(e) , 

B(fc)  =  D"^(e)P“^(e)B(e)  ,  then  ‘^^(e)  is  over  lR[[e]]  iff  is 

over  IR[ [e] ]  . 

Proof :  (-»)  Follows  from  the  transformation. 

(«-)  Clearly  ^^(£)=Q(e)  is  over  IR[[e]],  and  the  rest  follows  using 
Lemma  2.3  and  the  Cay ley-Haml 1  ton  theorem.  •• 

We  can  now  prove  Proposition  2.6: 

Proof  (of  Proposition  2.6):  (1^2)  Follows  from  the  definition  of  a 
proper  form  and  the  structure  in  (2.4). 

(2-»l)  By  Lemma  2.8,  ^^(e)  is  over  K[[e]].  Consider 
‘€^^j^(e)  =  [B(e)  |  A{e)'€^(e)],  which  is  also  over  K[[e]].  Then, 

B(e)  is  over  K[[£]].  Also,  A(e)  is  over  lR[[e]]  since  is 

full  row  rank  at  e=0  and  therefore  has  a  right  inverse  over 

Thus,  (D(e)A(e)D  ^  (e)  ,  D(e)B(e) )  is  a  proper  standard 

f  orm . 

(2<— ^3)  Lemma  2.7  •• 
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As  an  immediate  consequence  of  statement  2  of  Proposition  2.6 
we  have  the  following  important  property  of  proper  systems: 

Coro  1  lary  2.9:  Given  a  proper  pair  (A(e),B(e)),  x  €  iff  x  is 
reachable  with  0(l/e^)  control  in  p  steps,  for  all  p>n.  •• 

Let  us  also  supplement  Proposition  2.6  with  the  following: 
Corol  lary  2.10:  *e^{e)  is  over  IR[[e]]  iff  ^^+1^^^  over  KCCe]]. 
Proof :  (-»)  Since  =  C®(^)  I  A(e)^^(e)].  and  is  full 

row  rank  at  e=0,  A(e)  are  B{e)  are  over  K^CC^]]-  Thus,  is 

over  lR[[e]]. 

(«-)  Trivial. 

The  standard  form  will  prove  to  be  very  useful  to  us, 
especially  for  finding  feedback  to  place  eigenvalues  (Section 
III).  In  the  Appendix  we  develop  an  algorithm  to  get  to  a 
standard  form  without  first  constructing  the  reachability  matrix 
and  then  explicitly  determining  its  Smith  decomposition  in  order 
to  obtain  the  transformation  matrix  P(e).  The  algorithm  works 
directly  on  the  pair  {A(e).B(e)),  and  is  a  natural  extension  of 
the  recommended  procedure  [3]  for  testing  reachability  of  a 
constant  pair  (A,B). 

I I. 4  CONTINUOUS  TIME 

The  natural  counterpart  to  Definition  2.2  for  continuous  time 
is  as  follows: 
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Def  ini  tion  2.11:  x  €  K^CCfc]]  is  e'^-reachable  if  3  t€IR^  and 
u(t)  €  l/e'^IR'"[  [e]  ]  V  t€[0,T]  such  that  x(t)  =  x.  with  x(0)  =  0. 

Let  be  the  set  of  all  e^-reachable  states,  then 

SC°  C  C  C  ...  and  is  an  iR[ [e] ]-subinodule  of  IR^[[e]].  We 
term  3C^  the  &*^-reachable  submodule.  •  • 

These  submodules  have  properties  analogous  to  those  of 
discrete  time  for  proper  systems,  as  the  following  proposition  and 
corollary  show  (the  proofs  are  given  in  detail  in  [22]): 

Propos i tion  2.12:  Given  a  continuous  time  proper  system  descibed 

by  the  pair  (A(e),B{e)),  then  9C^=<A{fc)  |S5^>niR’^[[e]]  where 
n 

<A{e)  |95^>=^A^  ^(e)3S^  and  is  the  image  of  B(e)  over  1R[[£]]. 

1 

•  • 

Coro  1  lary  2.13:  =  P(£)D(e)lR*^[[e]]  where  '6(e)  =  P(e)D(e)Q(e)  is 

a  Smith  decomposition  for  the  reachability  matrix. 

Using  the  iterative  relation  3C^^^=^{3C^nfclR'^[  [e]  ]  }  , 

(Proposition  2.2),  we  can  recover  all  the  other  reachability 
submodules  from  the  Smith  decomposition  of  the  reachability  matrix 
and  Corollary  2.13.  Therefore,  all  our  results  for  discrete  time 
also  hold  for  continuous  time. 
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III.  SHIFTING  EIGENVALUES  BY  0(1)  USING  FULL  STATE  FEEDBACK 


In  this  section,  we  restrict  our  attention  to  systems  over 
These  systems  are  proper  and  all  eigenvalues  of  A(e)  are 
0(1).  We  address  the  problem  of  arbitrarily  shifting  these 
eigenvalues  by  0(1),  using  full  state  feedback.  In  other  words, 
we  wish  to  find  F(fc)  over  lR((e))  such  that  Ap(£)  =  A(e)+B(e)F(e) 
has  the  desired  eigenvalues  at  e=0. 


Example  3.1:  The  eigenvalues  of  A(e)  in  Example  2.1  are  at  l+0(e) 
and  2+0(e).  A  state  feedback  of  [2  4]  shifts  these  eigenvalues  to 
3+0(fc)  and  2+0(e).  It  is  not  hard  to  see  that  there  is  no  0(1) 
state  feedback  that  can  move  the  eigenvalue  at  2+0(e)  by  0(1). 
However,  a  state  feedback  gain  of  [5  -l/e]  shifts  the  eigenvalues 
to  3+0(e)  and  4+0(e).  Here  both  eigenvalues  are  moved  by  0(1), 
but  an  0(l/e)  feedback  gain  has  to  be  used.  Note  that  the  closed 
loop  system 


Ap(£) 


6  1-1/e 
_6e  1 


is  not  over  IR[[fe]]  but  it  is  e-reachable  with  the  same  indices, 
nQ=l  and  n^sl ,  as  the  original  system,  and  is  in  proper  standard 
f  orm .  •  • 


We  shall  now  show  that,  for  systems  over  IR[[e]],  the  order  of 
feedback  gain  necessary  and  suf f i c i ent  to  move  all  eigenvalues  by 
0(1)  is  directly  given  by  the  order  of  reachability  of  the  system. 
Let  us  start  by  looking  at  e^-reachable  systems.  In  all  that 
follows,  A  denotes  a  self-conjugate  set  of  n  eigenvalues,  (7(A) 
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denotes  the  spectrum  of  A.  and  Z  denotes  the  set  of  all  integers. 
Define 

a  =  min  {r|  VA .  3F(e),  0(l/e^).  s.t.  CT{A(e)+B(e)F{e) )  |  _^=A}  (3.1) 
r€Z 

Hence  a  is  the  smallest  order  of  feedback  gain  that  will  produce 
arbitrary  0(1)  eigenvalue  placement. 

Proposi tion  3.2:  The  pair  (A(e),B(e)).  over  is 

e^-reachable  iff  a=0 . 

Proof :  (-»)  If  the  pair  (A(e),B(e))  is  e^-reachable .  then,  ^(e)|^_Q 

has  full  row  rank.  Thus,  the  pair  (A(0),B(0))  is  reachable,  and 

VA.  3F:|R”  k”  s.t.  a(A(fc)+B(fc)F)  =  ct(A(0)+B(0)F)  =  A.  Hence 

a^O.  Now  assume  a<0.  Then,  lim  F(e)  =s  0  for  those  F(fc)  of 

eiO 

0(l/e°^)  that  produce  arbitrary  0(1)  eigenvalue  placement  according 

to  (3.1).  But  then  lim  ( A(e)+B(e)F(e) )  =  A(0) ,  so  no  0(1) 

eiO 

eigenvalues  are  moved,  which  is  a  contradiction.  We  conclude  that 
0=0 . 

(<-)  Conversely,  assume  that  a=0,  then  VA,  3F=F(e)|^_Q  s.t. 
cr(A(0)+B(0)F)=A.  Thus,  the  pair  (A(0),B(0))  is  reachable,  and 
'®(e)|^_Q  has  full  row  rank,  so  the  pair  (A(e),B(e))  is 
e^-reachable . 

Proposi tion  3.3:  The  pair  (A(e),B(e)),  over  K[[£]].  is 
e  -reachable  iff  a  =  k. 

Proof :  (-»)  If  the  pair  (A(e),B(e))  is  e  -reachable,  then  the  pair 

A(fc)  =  D"^(e)P“^(e)A(e)P(e)D(e) .  B(e)  =  D~^(e)P“^(e)  is 
e^-reachable  and,  by  Lemma  2.8,  is  over  lR[[e]]-  Thus,  by 
Proposition  3.2,  VA,  3  an  0(1)  F(fe)  s.t.  X( A( e )+B ( e ) F( e ) ) | =  A. 
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Let  F(fc)  =  F{6)D  ^(e)P  ^(e),  then  F(e)  is  0{l/e^).  By  Lemma 
the  closed  loop  pair  {Ajr{e)  ,B(e) )  is  proper  and  so  the 
coefficients  of  its  characteristic  equation  are  over  1R[[£]]. 
Thus , 

lim  a{A(£)+B(e)F(e))  =  lim  cT(A{e)+B(e)F(e) )  (3. 

fciO  eiO 

and  a<k.  To  see  that  the  equality  must  hold,  note  first  that 


A(e)  =  i.x  i.K.  ^3 


,,o(0 

eAo  i(e)  . 

Ai,l{e)  . 

k-1,  ’  ,  . 

.  .  e  A^  j^(e) 

Ajj  l(fc)  . 

“-^k-1 

columns 

Now,  if  a<k,  then  the  last  n-nj^_j  columns  of  F(0)  = 

limF(e)P{e)D{e)  =  0  for  those  F(e)  of  0(l/e°^)  that  produce 
eiO 

arbitrary  eigenvalue  placement  according  to  (3.1).  But  then 

lim{A{e)+B{e)F{e))  =  ^  ^ 

elO  '•  k,k 


(0) 


(3. 


where  a  denotes  some  constant  entries,  and  the  eigenvalues 
corresponding  to  Aj^  not  moved  by  0(1),  which  is  a 
contradiction.  We  conclude  that  a=k. 

(«-)  Clearly,  the  pair  (A{e),B(e))  is  e^-reachable  for  some  j. 
the  first  part  of  this  proof,  a= j .  Hence  j=k  and  the  pair  is 


e  -reachable. 


Note  that  if  some  pair  {A(e),B(e))  over  IR[[e]]  is 
e^-reachable  then  the  closed  loop  pair  {Ap(e) , B(e) ),  where 
Ap{fc)  =  A(e)+B(e)F(e) ,  is  e^-reachable  for  all  F(e)  of  0(1). 
we  have  the  following  result: 


2.4, 


2) 


3) 


4) 


By 


Thus 
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Coro  1  lary  3.4:  Given  a  pair  (A(6),B(e))  over  the 


e*^-reachabi  1  i  ty  indices  n^ ,  as  defined  in  Section  II. 3,  are 
invariant  under  any  feedback  of  the  form  F{fc)  =  F(e)D  ^(e)P  ^{e) 
where  F(e)  is  0(1).  Also,  the  closed  loop  pair  is  proper.  •• 

The  e^-reachable  submodules  of  the  standard  form  are  uniquely 
determined  by  the  indices,  and  the  e'^-reachable  submodules  of  the 
original  system  are  uniquely  determined  by  the  e''-reachable 
submodules  of  the  standard  form,  via  P{e).  Thus: 

Coro  1 lary  3.5:  Given  a  pair  {A{e),B{e))  over  K[[e]].  the 
e^-reachabi 1 i ty  submodules  are  invariant  under  any  feedback  of  the 
form  F{e)  =  F(e)D  ^{e)P  ^(e),  where  F(e)  is  0(1). 

For  the  more  general  class  of  proper  systems  over  IR((e)),  the 
orders  of  feedback  gains  do  not  necessarily  match  the  orders  of 
reachability.  Let  us  consider  the  following  example: 

Example  3.6:  The  pair 


0  0  0  ■ 

1  o' 

A(e)  = 

0  0  1/e 

0  2e  0 

II 

PQ 

0  1 

0  0 

corresponds  to  an  e-reachable  system  in  proper  standard  form.  Let 


where  the  f^  are  all  scalar  constants,  then 

det{XI-Ap(e))  =  A^-(f  ^  +  f^)X^+(f  jf^-f2f3-2)X+2f  ^  .  Clearly.  f^€IR 
can  be  chosen  appropriately  to  match  any  third  degree  polynomial 
with  real  coefficients.  Therefore  all  eigenvalues  of  A{fc)  can  be 
arbitrarily  moved  by  0(1)  using  only  0(1)  feedback  gains.  What 
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happens  in  this  example  is  that  an  0(1)  gain  for  the  third  state 
component  produces  an  0(l/e)  input  for  the  second  component. 
Therefore,  even  with  0(1)  gains,  the  input  values  themselves  will 
be  0(l/e),  as  would  be  expected  when  producing  0(1)  shifts  in 
eigenvalues  for  this  e-reachable  system.  •• 

The  overall  effect  of  0(1)  feedback  on  the  eigenvalues,  even 
for  systems  over  is  a  more  subtle  issue  than  the  order  of 

feedback  necessary  to  shift  the  eigenvalues  by  0(1).  Consider  the 
following  example: 

Example  3.7:  Let 


The  reachability  indices  are  n^sl  and  n^-2.  The  eigenvalues  of 
A(e)  are  at  iVe.  Feedback  of  [-1  -1]  moves  the  eigenvalues  to  -1 
and  -e.  Thus,  the  effect  of  feedback  is  larger  than  0(e),  namely 
0(Ve).  (It  is  worth  noting  that  the  original  system  did  not  have 
well-behaved  time  scale  structure  in  the  sense  of  [1,2],  and  that 
the  feedback  produces  well-behaved  time  scale  structure.)  •• 

We  leave  these  problems  for  further  research.  Chapter  V 
suggests  some  potential  extensions. 

An  extension  of  Algorithm  A. 3  can  be  used  to  compute  the 
feedback  matrix  necessary  to  shift  eigenvalues  by  some  desired 
amount.  Application  of  Algorithm  A. 3  produces  a  pair 
(Aj^(e),Bj^(e)),  where  A^{e)  =  S"^  (e)A(e)R(e)  ,  Bj^(e)  =  S“^(e)B(e), 
where  (Aj^(O)  , Bj^(O) )  is  reachable  and  S(e)  is  the  product  of  all 
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the  similarity  transformations  used  to  achieve  the  final  pair. 


From  the  pair  ( Aj^(O)  , Bj^(O) )  ,  we  can  compute  a  feedback  matrix  F 
such  that  the  eigenvalues  of  Aj^p(O)  =  Aj^(O)  +  Bj^(0)F  are  as 
desired.  We  have  that  cr{Aj^p{e) )  |^_q=ct(Aj^p(0)  )  and  that 
(AkpCe) .B{e) )  is  proper.  Let  F(e)  =  FS  ^{fe)  and  Ap(e)  =  A(fc)  + 
B{e)F{e).  Since  S(e)  is  invertible  for  e€(0,a)  for  some  a€IR, 
(Ap{e),B(e))  is  also  proper.  Therefore,  as  in  the  proof  of 
Proposition  3.3,  the  eigenvalues  of  Ap(e)  are  as  desired. 


This  algorithm  was  applied  in  [22]  to  a  fifth  order,  weakly 
reachable  system  over  IR  with  one  input.  The  system  was  first 
parametrized  by  replacing  certain  small  entries  by  (0(1)  multiples 
of)  powers  of  e.  The  feedback  gain  to  place  0(1)  eigenvalues 
calculated  for  the  parametrized  system  by  the  above  approach  was 
evaluated  at  the  specific  value  of  e  corresponding  to  the  original 
system.  This  approach  produced  far  better  numerical  results  than 
calculating  the  feedback  directly  for  the  given  system.  Similar 
concerns  have  been  expressed  by  authors  interested  in  numerical 
issues  of  multivariable  pole  placement  for  linear  time  invariant 
systems  (as  explained  in  I.l).  Our  approach  would  attempt  to 
address  those  issues  by  scaling  the  pair  (A,B)  appropriately. 
Unfortunately,  (A,B)  has  to  be  parametrized  by  e  first.  Further 
study  of  this  problem  has  been  left  for  future  research,  though 
some  heuristic  suggestions  for  parametrizations  are  made  in 
Section  V. 
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IV.  ALMOST  INVARIANT  SUBSPACES 


IV. 1  (A(e) ,B(e))-INVARIANCE  AND  ALMOST  (A. B)- INVARIANCE 

In  this  section,  we  use  our  framework  to  provide  some  new 
Insights  on  the  notions  of  almost  (A, B)-invariance  and  almost 
(A , B)-control labi 1 i ty .  introduced  by  J.  C.  Willems  [17]  into  the 
geometric  approach  to  linear  systems,  [10]. 

To  give  a  flavor  for  our  approach,  let  us  consider  the 
following  example: 

Example  4.1:  Let 


It  is  easy  to  see  from  the  results  in  [17]  that  H  =Im[l  0]’  is  an 
almost  {A,B)-invariant  subspace.  Consider  the  family  of 
subspaces,  {"f  •  generated  by  [1  e]  ’  for  each  fixed  e  €  (0,«>). 

Since 

these  subspaces  are  ( A,  B)-invar iant ,  [10].  As  we  let  e  0, 

{f  }  -*  f  =Im[l  0]’,  which  is  an  almost  (A,B)-invariant  subspace. 

&  Si 

So  we  have  found  a  sequence  of  (A, B)-invariant  subspaces 
evaluated  at  different  values  of  e)  that  converge  to  an  almost 
( A , B)-invar iant  subspace.  Using  the  relation  (-l/e)  =  F{e)[l  e] ’ 
with  F{fc)  =  [-l/e  0],  these  subspaces  are  Ap{e)  invariant  where 
Ap(e)  =  A  -  BF{e)  =  °  . 

Furthermore,  the  {"V are  coasting  subspaces,  [17],  i.e.  they  are 
(A,B)-invariant  but  they  have  no  {A, B)-control lable  part,  whereas 
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is  a  sliding  subspace,  [17],  i.e.  it  is  almost  {A,B)-invariant 
but  it  has  no  (A, B)-invariant  part. 

Note  that  an  eigenvalue  of  Ap(e)  -»  +<»  as  e-K) .  On  the  other 
hand,  consider  the  family  of  {A,B)-invariant  subspaces, 
generated  by  [1  -e]  ’  .  As  e-»0,  also.  By  going  through  the 

above  procedure,  we  get  F’(e)  =  [1/e  0]  and 

Ap.(e)  =  °]. 

Now  the  eigenvalue  of  Ap,{e)  that  blows  up  approaches  as  e-K) . 


We  proceed  with  proving  some  results  related  to  the  above 
observations,  but  we  first  state  some  algebraic  properties  that  we 
use  extensively. 


K”({e))  is  a  vector  space  over  the  field  E((e)).  Let  f ^  he  a 
subspace  of  R’^((e))  and  let  the  columns  of  V(e)  =  [Vj{fc)l  ... 
|v^(e)]  be  a  linearly  independent  set  that  spans  Since  f ^  is 

closed  under  multiplication  by  elements  in  R((e)),  it  is  possible 
to  pick  Vj(e)  such  that  Vj(e)  C  R[[e]]  and  V{0)  has  full  column 
rank.  Hence  V(e)  has  full  column  rank  for  small  enough  e.  Note 
that  the  span  of  the  columns  of  V(e),  for  any  fixed  e,  is  a 
subspace  of  Thus  it  is  also  possible  to  think  of  as  a 

sequence  of  subspaces  of  R^  defined  by  V(e)  for  different  values 
of  e.  We  use  this  to  connect  our  results  to  their  counterparts  in 
[17]  and  [10]. 

Definition  4.2:  f  CR"({e))  is  f Afel , Bf 1-invar iant  if  3  F ( e ) : 

R"*((e))  s.t.  Ap(e)t^  C  11^,  where 
Ap(e)  =  A(e)  +  B{e)F{e). 
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We  denote  the  family  of  {A(e)  ,B{e)  )-invariant  IR{  (e)  )-subspaces  by 
V ^ .  In  some  cases,  we  shall  consider  (A(e) ,B{fc) )-invariant 

{^)  )“subspaces  for  A(e)=A  and  B(e)=B.  We  use  the  same  notation, 
and  assume  that  the  reader  will  infer  the  relevant  underlying 
system  from  the  context.  Following  Willems  [17],  we  denote  the 
family  of  (A , B)-invar iant  subspaces  by  V  and  the  family  of  almost 
{A,B)-lnvariant  subspaces  by  . 

A  straightforward  extension  of 
following  well  known  result  [10]: 

Proposition  4.3:  iff  A(e)f^ 

SS  =  B{e)IR™({e))  . 

Definition  4.4:  Given  f  C  and  f  C  f  - *  11  if 

-  ^  ^  ^  e-K)  ^ 

whenever  {Vj^{fc),  ...  ,  ^  D^”[[^]]»  is  a  basis  for  f  ^ , 

the  set  of  vectors  {Vj(0),  ...  ,  v^{0)}  forms  a  basis  for  "f ^  (this 

is  convergence  in  the  Grassmanian  sense).  *• 

One  can  always  construct  a  matrix  W(e)  over  lR[[e]]  such  that 
W(0)  =  I  and  v^(e)  =  W{e)v^(0).  Thus  an  alternate  representation 
of  1f^  would  be  W{e)t^. 

The  following  result  enables  us  to  establish  a  connection 
between  our  framework  and  the  notion  of  almost  (A,B)— invariance . 

It  provides  a  method  to  compute  approximations  for  the 
distributional  inputs  required  to  steer  the  trajectories  of  an 
almost  {A,B)-invariant  subspace  exactly  through  that  subspace. 
Using  these  high  gain  feedback  approximations  one  can  steer 


this  definition  is  the 


C  +  SS,  where 
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trajectories  arbitrarily  close  to  an  almost  {A,B)-invariant 
subspace . 

Proposi tion  4.5:  For  a  given  pair  (A.B).  ^  3 

such  that  f  - *  D  . 

e  a 

e-K) 

The  proof  is  very  similar  in  principle  to  that  of  Willems 
[17]  and  it  is  given  in  detail  in  [22].  However,  note  that  the 
converse  of  the  above  proposition  does  not  hold,  though  [17] 
claims  that  it  does.  To  illustrate  this,  consider  the  following 
example : 

Example  4.6:  Let 


A  = 

I.. 

Os' 

0., 

and  B  = 

■'s' 

0., 

[3 

3j 

3 

Consider  H  =  { v ^ (e ) , V2(&) . }  where  Vj{e)  =  [1  0  0  0  e  0]’, 

V2(e.)  =  [0  0  0  1  0  0]’,  =  [0  1  0  0  0  1]’  and  {•}  denotes 

span  over  IR((e)).  f  €  V  and  f  - »  ^  where 

^  e-K) 

^  =  {Vj (0) , V2(0) , V2{0) }  and  {•}  denotes  span  over  K.  But  ^  is  not 
an  almost  (A,B)-invariant  subspace. 

Willems  [17]  poses  the  problem  of  finding  an  input  that 
steers  the  trajectories  of  a  system  arbitrarily  close  to  an  almost 
(A, B)-invarlant  subspace.  Our  approach  shows  how  this  can  be 
done.  We  show  below  how  to  construct  an  (A,B)-invariant 
{^)  )~subspace  that  approaches  the  almost  (A,B)-invariant 
subspace  in  the  Grassmanian  sense.  The  desired  input  then  follows 
on  calculating  the  feedback  that  makes  the  (A,B)-invarlant 
(^)  )“sul3sp^ce  Ap(e)-invar  iant . 
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Recall  from  [17]  that  any  almost  {A , B)-invariant  subspace  f 

SI 

can  be  represented  as  f  :=f+?k  where  "t!  Is  ( A , B)-invar iant  and  ^  is 

almost  (A , B) -control lable  and  any  almost  ( A , B) -cont ro 1 labi 1 1 ty 

subspace  can  be  represented  as  SS  where  91  is  the 

a  a  o  s  o 

supremal  ( A , B) -contro  1  labi  1  i  ty  subspace  in  9^  and  95  is  a  sliding 

S 

subspace.  By  a  construction  in  the  proof  of  Proposition  4.5  in 
[22],  we  can  f ind  f  €  V  where  f  =Q(e)95  ,  Q{e)  over  IR[[e]]  and 
Q(0)  =  I,  where  is  a  coasting  IR(  (e.)  )-subspace  whose  associated 
eigenvalues  approach  as  e-O.  The  feedback  F(£)  that  makes  f 

c 

an  Ap{e)-invar iant  1R{ (e) )-subspace  can  be  calculated  and  provides 
the  desired  input.  Those  eigenvalues  of  Ap(e) .  for  fixed  e,  that 
correspond  to  95^  approach  as  e-*0 .  This  increases  the  magnitude 
of  the  feedback  gains,  and  the  generated  inputs  and  their 
derivatives  approach  impulses  in  the  limit.  The  eigenvalues 
corresponding  to  can  be  assigned  by  the  usual  pole  placement 
methods . 

As  an  illustration  of  the  procedure,  consider  the  following 
example,  which  contains  the  essential  features  of  the  general 
case : 

Example  4.7:  Let 


0 

0 

o' 

1 

1 

0 

A  = 

1 

0 

0 

1 

0 

0 

.  B  = 

0 

0 

,  where  v^^  = 

0 

0 

and  Vg  = 

1 

0 

H  is  an  almost  { A , B) - invar iant  subspace,  and  in  fact  it  is  a 

3. 

sliding  subspace.  Consider  =  {v^ (e) , VgC^) } .  where 

Vj(e)  =  [1  -e  e^] ’  and  =[01  -2e] ’ .  Note  that  is  a 

coasting  IR(  (e)  )-subspace  ,  i.e.  it  is  ( A ,  B)-invar  iant  but  not 

( A ,  B)-contro  1  lable  .  Furthermore,  Vj^(O)  =  Vj  ,  V2(0)  =  Vg  and 

f  - *'f  .  Also,  V .  (e)=P{e)v .  ,  for  i  =  l,2,  where 

ail 
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P(e)  = 


1  0  0 
-e  1  0 

2e  1 


gets  its  lower  triangular  entries  from  a  Pascal  triangle 
construction  with  alternating  signs  (see  [22]).  Solving  the 
equations  A( e ) [ ( e ) | e ) ]  =  [ ( e )  | VgC t) ]g^( e )+Bg^( e )  and 
gu(^)=^(^)Cv^{e) |v2(e)]  yields  F(e)=[2/e  1/e^  0]’  and 


Ap{e)  =  A  -  BF{6)  = 


-2/e  -1/e  0 

1  0  0 

0  1  0 


with  being  Ap(e)-invar iant .  Note  that  the  desired  input 
u(t)  =  -F(e)x{t).  On  the  other  hand,  the  eigenvalues  of  Ap(e) 
that  correspond  to  f  ,  for  fixed  e,  are  both  at  -1/e.  They  are 

3. 

stable  and  approach  -®®  as  e^. 


IV. 2  (A(e) .B(e) ) -CONTROLLABILITY  AND  ALMOST  (A,B)-INVARIANCE 

We  now  proceed  with  the  notion  of  { A{e) , B(e) )-contro 1 labi 1 1 ty 
{^)  )~subspaces ,  adopting  Wonham’s  definition  [10]  of 
( A . B)-control labi 1 i ty  subspaces: 

Def ini tion  4.8:  ^  G  {{&))  is  an  (A(e) .Bfe))-c on troll ability 

subspace  if  there  exist  maps  F(e)  :1R’^(  (e) )  -»  lR”'{{e))  and 

G(e)  .-IR^CCe))  ^R®((e))  such  that  01  =  <A{e)+B{e)F(e)  1  Im(B(e)G(e)  > . 

We  denote  the  family  of  (A{e) , B{e) )-control labi 1 i ty 
( ^)  )  “Subspaces  by  R  ^  .  For  some  cases,  we  consider 
(  A(e)  ,  B(  e)  ) -control  labi  1 1  ty  1R(  (e)  )-subspaces  for  A(e)=A  and 
B(e)=B.  The  same  notation  is  also  used  for  these  cases. 

Following  [17]  we  denote  the  family  of  ( A , B)-contro 1 labi 1 i ty 
subspaces  by  R  and  the  family  of  almost  ( A , B)-control labi 1 i ty 
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subspaces  by  . 

To  put  the  above  definition  into  a  more  usable  form,  consider 
the  following  proposition,  which  simply  restates  results  of  Wonham 
[10]  in  the  present  framework: 

Proposi  tion  4.9:  (a).  34  €  iff  there  exists  a  map 

F(e )  :  1R^(  (e)  )-4R"'{  (e)  )  such  that  94  =  <A{e)+B(e)F(e)  |28n94>  where  94 

represents  the  range  of  B{fc)  over  lR{{e)). 

(b)  .  S4  =  <Ap(e)  |S4n94>  for  every  map  F{e)  €  F(94)  .  where  F(94) 
represents  the  family  of  feedback  matrices  F{e)  such  that  ^  is 
Ap(e) -invariant . 

Proof :  The  proofs  are  very  similar  to  that  of  Wonham  [10]  and  they 
are  given  in  [22]. 

Let  94  €  R  and  S4  - *  94  .  Then,  it  turns  out  that  94  is 

e  — e  e  „  n  n 

e-»0 

almost  (A,B)-invariant .  Finding  inputs  for  steering  trajectories 
arbitrarily  close  to  94^  is  done  by  calculating  an  F(e)  such  that 
is  Ap(e)-invar iant  and  the  eigenvalues  corresponding  to  94^  are 
0(1)  and  asymptotically  stable.  The  following  lemma  and 
proposition  show  this: 

Lemma  4.10:  Given  a  pair  (A.B),  let  94  €  R  and  94  - >94  .  then  V 

^  ^  ^e-»0 

0(1)  Xq  s.t.  d(xQ,94^)  is  0(e)  and  Vt>0,  3  an  input  function  u(t) 
s.t.  d(xQ(  t .  e )  ,  94^)  is  0(e)  for  0<t$T.  where  XQ(t,e)  is  the 
trajectory  defined  by  u(t)  and  the  Initial  condition  Xq . 

Proof :  Here  we  first  need  to  find  a  trajectory  in  94^  which  is  0(1) 
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for  0<t<T.  Find  F{e)  s.t.  is  Ap(e)-invariant  and  the 

eigenvalues  of  Ap(e)  corresponding  to  3^^  are  all  0(1)  and 

asymptotically  stable.  Then  V  0(1)  x.  €  SS  .  x-(t,e)  €  ^  Vt>0 

where  Xj(t,e)  is  the  trajectory  defined  by  the  initial  condition 

Xj  and  the  input  specified  by  F(e)x(t).  Since  the  eigenvalues  of 

Ap(e)  corresponding  to  are  all  0(1)  and  stable,  Xj(t,e)  is  also 

0(1).  Therefore,  d(Xj  ( t ,  e)  ,  3^^)  is  0(e),  since  the  ’angle*  between 

^  and  3^  is  0(e).  Consider  x„(t,e),  the  trajectory  defined  by 
£>11  ^ 

the  initial  condition  X2=Xq-Xj  ,  with  x^  €  chosen  such  that  Xg 
is  0(e).  Since  the  eigenvalues  of  Ap(e)  are  0(1),  Vt>0  X2(t,e)  is 
0(e)  for  0<t<T.  Thus,  d(xQ( t , e) ,^^)  is  0(e)  for  0<t<T. 

Proposi  tion  4.11:  Given  a  pair  (A,B),  let  ^  ^  K  a-mi  ^  • 

then  €  V  . 
n  —a 

Proof :  Pick  some  t>0  and  apply  Lemma  4.10.  Thus,  3u(t)  s.t. 

d(x(t,e),^^)  is  0(e)  for  0<t<T.  Then  3  e^>  0  s.t. 

d(x(  t ,  e)  ,  3^^)  <  6  for  0<t^T  and  Ve<e^.  Use  x(T,e)  as  the  initial 

condition  to  reapply  Lemma  4.10  for  the  interval  t  <  t  <  2t.  Find 

e.>0  s.t.  e,<e  and  d(x(t,e.),35  )  <  6  for  t  <  t  <  2t  .  Repeated 
1  l~o  '•'■l-'n^  ^ 

use  of  Lemma  4.10  achieves  the  desired  result. 

To  illustrate  these,  consider  the  following  example: 

Example  4.12:  Let 


A  = 

0  0  o' 
0  0  0 

.  B  = 

1  o' 
0  1 

and  31  =  Im 

l' 

e 

+  Im 

o' 

0 

0  10 

0  0 

e 

.0. 

_e 

Note  that  3^^  =  Im[l  0  0]’  +  Im[0  0  1]’  and  it  is  an  almost 
( A , B) -invar iant  subspace.  Let  F(£)  =  [-3  0  -2/e],  then  3^^  is 
Ap(e)-invar iant  and  the  eigenvalues  corresponding  to  28^  are  at  -2, 
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-4,  asymptotically  stable  and  0(1).  Pick  the  initial  state  of 

Lemma  4.10  as  x^  =  [  1  0  0]  ’  .  Let  =  [1  e  0]’  €  34^.  Then, 

Xj(t.e)  =  [-e~^2e"2t  -ee"S2ee“2t  -ee"^-ee~2^]  •  €  .  and 

e 

d(Xj^(t,e)  ,9^^)  is  clearly  0(e)  for  any  finite  t.  On  the  other 
hand,  x^  =  [0  -e  0]’  and  =  [2ee“^^  2e^e~^^  -e^e“^^]  ’  . 

Thus.  d(xQ(t).35^)  is  0(e).  So.  in  the  spirit  of  Proposition  4.11. 
this  may  be  bounded  by  any  6  for  any  given  t  by  picking  an 
appropriate  e=e^.  Then,  using  x(T.e)  as  the  new  initial  state  and 
repeated  use  of  this  procedure  achieves  the  desired  result. 

In  this  section,  we  examined  the  notions  of  almost 

(A, B)-lnvarlant  and  almost  ( A . B)-contro 1 labl 1 1 ty  subspaces  in  the 

framework  that  we  have  developed  in  this  paper  and  [22].  We 

outlined  a  method  for  calculating  Inputs  that  steer  trajectories 

arbitrarily  close  to  almost  (A,B)-invar iant  subspaces  or 

equivalently  force  the  eigenvalues  corresponding  to  sliding  parts 

of  almost  (A,B)-controllability  subspaces  to  approach  -«>.  We  also 

analyzed  the  properties  of  limits  of  elements  in  V  and  R  as  eio 

— e  — e 

from  a  trajectory  point  of  view. 
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V.  CONCLUSIONS 


In  this  paper,  we  have  developed  an  algebraic  approach  to 
high  gain  controls  for  linear  dynamic  systems  with  varying  orders 
of  reachability.  Based  on  this  approach,  we  addressed  the  issues 
of  high  gain  inputs  for  reaching  target  states,  high  gain  feedback 
for  pole  placement  and  high  gain  inputs  for  steering  trajectories 
arbitrarily  close  to  almost  {A,B)-invariant  subspaces  and  almost 
( A , B) -contro 1 labi 1 i ty  subspaces. 

The  results  presented  here  suggest  several  direction  for 

further  research.  It  is  of  interest  to  analyze  the  orders  of 

feedback  gains  for  shifting  eigenvalues  by  0(1)  in  the  more 

general  case  of  proper  systems,  rather  than  just  systems  over 

Intuitively,  if  a  mode  is  e-reachable  but 

"1/e-observable",  in  that  it  has  a  1/e  coupling  to  other  states, 

then  it  should  be  possible  to  shift  its  eigenvalue  by  0{1)  using 

0(1)  feedback  gain.  A  related  problem  is  that  of  changing  the 

dynamics  of  a  given  continuous  time  system  that  has  multiple  time 

scales  [1].[2]  without  changing  its  time  scale  structure.  This 

i  i 

would  involve  shifting  0(e*^)  eigenvalues  only  by  0{e'')  rather  than 

0(1). 

A  key  problem  that  bears  attention  is  that  of  parametrizing 
systems  over  IR.  Two  heuristic  methods  could  be  suggested  for 
this.  One  is  to  recognize  small  entries  in  the  matrix,  either 
isolated  or  added  to  another  entry,  and  replace  these  with  powers 
of  e.  Another  method  for  parametr ization  could  come  from 


31 


numerical  reachability  tests  [3],  where  for  example  small  singular 
values  at  different  stages  of  a  test  may  be  replaced  by 
(appropriate  powers  of)  e. 

It  will  be  important  to  develop  dual  results  for  systems  with 
observations  y[k]  =  C(e)x[k]  or  y(t)  =  C{e)x{t).  This  could  then 
lead  to  research  on  connections  to  optimal  control,  realization 
theory  and  especially  to  the  work  on  balanced  realizations,  [8]. 
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APPENDIX 


Here  we  develop  an  algorithm  to  recover  a  standard  form 
without  forming  the  reachability  matrix  and  computing  its  Smith 
decomposition.  The  proofs  and  details  on  the  algorithm  are 
presented  in  [22].  Our  algorithm  can  only  deal  with  a  pair 
(A(e),B(e))  over  K[[e]],  so  this  restriction  is  assumed  here. 
Then,  the  structure  of  a  pair  (A(fc),B{fc))  in  standard  form  is  as 
f ol lows : 


A(6) 


*1,1*®* 


*0,k*®*]*>’0 
*l,lc*®*  *Pl 


®X,0*®* 


k-1 


k.  1 


(e) 


(A . la) 


B(e) 


Bo{^)l}Po 

eB^(e)  }pj 


B\(e) 


(A. lb) 


Proposition  A.l  :  An  e  -reachable  pair  (A(e),B(e))  over  lR[[e]]  is 
in  proper  standard  form  with  indices  p^,  ...  .  Pj^  iff  A(e)  and 

B{e)  satisfy  the  following  condition:  Let  F^{e)  =  ^  (e )  A(e)D  {e )  . 

G  (e)  =  D“^(fc)B(e)  where  D  (e)  =  diag{I  .....  e'l  +  n  ^ 

1  i  1  Pq  Pj-r  ...  T  pj^ 


then  the  reachable  subspace  of  (F^ (0) , G. (0) )  is 


for 


Vi  €  [0. . .k] . 
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Similar  to  the  submodule  structure,  the  e^-reachable 

subsystem  contains  all  e'^-reachable  subsystems  for  j  =  0 . 

i-1.  The  subsystems  are  layered  with  weak  couplings  of  different 
orders  of  e  between  each  component,  as  shown  in  Figure  A.  Also, 


muL  •  4  ^  ”1  ^ 

‘€i{e)lR  "[[e]]  0  "[[e]]  D  (A. 3) 

mn .  n-n.  „ 

and  the  sequence  {"g-Ce)®  ^[[e]]  @  R  converges  to  ^ 

in  k  steps.  In  other  words,  e^-reachable  submodules  of  the 

e^-reachable  subsystems  approximate  the  e  -reachable  submodule  of 

the  system  in  standard  form  upto  accuracy.  We  use  this  in  - 

Algorithm  A. 3  below. 

Computation  of  the  reachability  matrix  is  very  expensive. 

One  has  to  calculate  A'(e)B(e)  for  all  the  terms  in  the  expansions 
of  A(e)  and  B(e).  Thus,  it  is  desirable  to  work  directly  with  the 
pair  {A(e),B(e)).  The  following  algorithm  takes  advantage  of 
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Proposition  A.l  to  recover  the  e‘*-reachabi  1  i ty  indices.  At  every 
step,  the  reachable  subspace  of  a  pair,  evaluated  at  e=0,  is 
computed.  Then  the  pair  is  updated  by  an  appropriate  scaling  of 
the  unreachable  part  by  1/e.  The  algorithm  uses  the  coefficients 
of  the  Taylor  expansions  of  the  higher  order  terms  only  when 
necessary.  Also,  it  is  possible  to  recover  the  actual  Smith 
decomposition  of  the  reachability  matrix  from  the  algorithm,  if 
the  transformations  used  in  the  algorithm  are  restricted  to  be 
permutation  matrices  and  lower  triangular  matrices,  though  this 
restriction  compromises  numerical  stability  (see  [22]). 


Algorithm  A. 3: 

Initialize:  AQ(e)  =  A(e),  BQ{e)  =  B(e),  i  =  0 
Step  i : 


1.  Find  Tj^  such  that 


T.^A.fO)T.  = 
1  1  1 


^2  ^^1  —1 
^  ^  .  T.^B.(O)  = 

0  A.,  ^  ^ 


®ll>^i 


with  (Aj.Bj)  reachable.  This  determines  n. . 

2.  If  n^  =  n  then  go  to  End,  else  continue. 

3.  Let  A.^.fe)  =  DT^ { e)TT^ A . ( e)T . D . ( e) ,  B.^,  =  dT^ {e)TT^B . (e) 

where  D.(e)  =  diag{I  ,  el  }. 

1  ^  n  .  n-n .  * 


(It  is  not  necessary  to  carry  out  the  computation  for  all  the 


coefficients  of  A^(e)  and  Bj(e);  see  Notel  in  [22].) 

4.  Increment  i,  go  to  Step  i. 

Ic 

End:  k  =  i,  the  system  is  e  -reachable  with  indices  n^  ...  ,  nj^. 


34 


e^-reachable  system 

^ - ^ 


L _ J 


IjC 

FIGURE  A.l  Block  diagram  showing  the  structure  of  an  a  -reachable 

system  in  standard  form  (upper  off-diagonal  blocks  of  A  (e)  have 

s 

been  omitted  for  clarity). 
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